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Method for providing an interaction in an electronic device and an electronic 
device 

The present invention relates to a method and a device for providing an interaction 
5 and particularly, for providing a tactile interaction in an electronic device. 

Background of the invention 

Traditionally the user controls the device by pressing keys or other controls located 
10 on a limited area on the surface of the device. The system response is presented in 
graphical display. This type of user interface is not very usable e.g. in the following 
cases. If the device is very small with small keys in the keyboard and the user has 
thick gloves in his/hers hand, there is no access to keys. If the device is very small 
with a small display and there is limited sight or the user does not wear glasses, it is 
15 difficult for the user to have access to the display. 

In US patent 6,466,198 provides a system and a method for view navigation and 
magnification of the display of hand-held devices in response to the orientation 
changes along only two axes of rotation as measured by sensors inside the devices. 

20 The view navigation system is engaged and controlled by a single hand, which 
simultaneously presses two economically designed switches on both sides of the 
hand-held device. In other embodiments, the system engaged into the view 
navigation mode in response to an operator command in the form of a finger tap, or 
a voice command, or predefined user gestures. The response curve of the view 

25 navigation to sensed changes in orientation is dynamically changing to allow coarse 
and fine navigation of the view. Various methods are described to terminate the 
view navigation mode and fix the display at the desired view. Miniature sensors like 
accelerometers, tilt sensors, or magneto-resistive direction sensors sense the 
orientation changes. The system can be added to an existing hand-held device via an 

30 application interface of the device. 

There is no direct access to the keys or the display if the device is wearable or in a 
pocket or a bag. There are also many situations where the users attention is in other 
task than controlling the device: communication through the device, or the 
35 environment may temporarily require attention. 
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Summary of the invention 

The present invention describes a solution for interaction with handheld or wearable 
device by providing at least some limited control of the device other than e.g. 
5 pressing a specific key in the keyboard. The method of the present invention is a 
combination of using a motion sensor tuned for sensing the control action (e.g. a 
tap) of the user and tactile feedback pulse signal, which is perceivable in a wide 
range of conditions. 

10 Specific gesture, a tap or multiple taps, is used for controlling the device. Motion 
sensor (3 dimensional accelerometer, for example) is tuned to detect the tap on the 
surface of the device. Tap in any direction and position on the surface of the device 
is detected. Feedback from the device is provided by tactile means. Vibrating alert 
actuator is used to give a pulse that vibrates the device. This vibration can be felt 

15 also in most difficult cases. After the tap the user can hold his/hers hand in the 
location of the device, or press the device closer to his/hers body, in order to 
provide his/hers attention as a response. Visual and audible perception can also be 
directed to the environment or in the communication task. 

20 The present invention enables for the user successful use of the device in e.g. 
temporarily difficult situations, especially with limited access to controls and 
display or when traditional methods (visual or audible methods) are not possible to 
use. The intention of the present invention is to enhance the interaction to new, 
more sophisticated level. 

25 

According to a first aspect of the invention a method is provided for providing an 
interaction between a user of an electronic device, and the electronic device, said 
device comprising an user interface and a motion sensor capable of detecting three 
dimensional motion, characterized in that the method comprising the user providing 
30 a gesture by touching the device, said gesture comprising at least one component of 
the three dimensions, the device detecting said gesture and providing a feedback in 
response to said gesture detection. 

According to a second aspect of the invention an electronic device is provided for 
35 providing interaction between to a user of said electronic device, said device 
comprising an user interface and a motion sensor capable of detecting three 
dimensional motion, characterized in that the device comprises detecting means for 
detecting at least one touch of the user touching the device, said gesture comprising 
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at least one component of the three dimensions, feedback means for providing a 
feedback in response to said detected gesture. 

According to a third aspect of the invention a computer program product is provided 
5 for an electronic device for providing interaction between to a user of said 
electronic device, said device comprising an user interface and a motion sensor 
capable of detecting three dimensional motion, characterized in that the computer 
program product comprises; computer program code for causing the device to detect 
at least one gesture of the user touching the device, said gesture comprising at least 
10 one component of the three dimensions, computer program code for causing the 
device to provide a feedback in response to said detected gesture. 

In the following, the invention will be described in greater detail with reference to 
the accompanying drawings, in which 

15 

Figure 1 illustrates a flow diagram of a method according to an embodiment of the 
invention, 

Figure 2 illustrates a flow diagram of a method according to another embodiment of 
20 the invention, 

Figure 3 illustrates a block diagram of an electronic device according to an 
embodiment of the invention and 

25 Figure 4 illustrates a communication device according to an embodiment of the 
invention. 

Detailed description of the invention 

30 Figure 1 illustrates a flow diagram of a method according to the first embodiment of 
the invention. The steps of the method can be implemented for example in a 
computer program code stored in a memory of an electronic device. When 
explaining this method a reference has been made to the device 300 being illustrated 
in figures 3 and 4. 

35 

At step 101 the process begins, e.g. the device is started up and a menu structure is 
provided visually in a display of the device. At step 102 a signal from motion sensor 
314 is received. At step 103 it is detected whether there is a detectable tap or not. 
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For example the duration and/or the intensity of the signal tells if there is tap in 
question or was the device dropped on the floor. If there was no tap at step 103 the 
flow proceeds to step 102. If there was a tap at step 103, the amount of taps is 
counted at step 104. If the tap or taps were tapped on the X-axis at step 105 as 
5 shown in figure 4, the flow proceeds to step 106, wherein an operation relating to 
the x tap or taps is performed. Next a tactile feedback is provided at step 107 to the 
user of the device by aid of a vibrator 315 as illustrated in figure 3. Similarly, if the 
tap or taps were tapped on the Y-axis at step 108 (or Z-axis at step 1 1 1) as shown in 
figure 4, the flow proceeds to step 109 (or step 1 12), wherein a operation relating to 
10 the y tap or taps is performed. Next a tactile feedback is provided at step 110 (or at 
step 1 13) to the user of the device by aid of a vibrator 3 15 as illustrated in figure 3. 

Figure 2 illustrates a flow diagram of a method according to the second embodiment 
of the invention. The steps of the method can be implemented for example in a 

15 computer program code stored in a memory of an electronic device. When 
explaining this method a reference has been made to the device 300 being illustrated 
in figures 3 and 4. In this exemplary illustration, there is a speed dial register 
comprising four telephone numbers with names stored in the memory of the device 
300. "dial 1" for name "Ronja" and for number "0400 123456", "dial 2" for name 

20 "Olli" and for number "040 7123453", "dial 3" for name "Aapo" and for number 
"041 567890", and finally "dial 4" for name "Henri" and for number "0500 
8903768". 

At step 201 the process begins, e.g. the device is started up and a menu structure is 
25 provided visually in a display of the device. Let us now assume that the user of the 
device is going to make a phone call to Henri ("dial 4"). First he/she selects the 
number being used, as illustrated in the following. The user of the device 300 taps 
four times. At step 202 a signal from a motion sensor 309 is detected. At step 203 it 
is detected whether there is a detectable tap or not. For example the duration and/or 
30 the intensity of the signal tells if there is a tap in question or was the device dropped 
on the floor. If there was no tap at step 203, the flow proceeds to step 202. If a tap is 
detected at step 203, it is next determined at step 204, whether a call is in progress 
or not. If there is no call in progress at the moment, the flow proceeds to step 205, 
wherein the taps are counted by e.g. a counter. 

35 

At steps 206-210 it is checked whether there was/were only one tap (step 206), a 
double tap (step 207), two taps (step 108), three taps (step 209) or four taps (step 
210). In this example the user tapped four times, therefore the flow next proceeds to 
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step 215 in order to select "dial 4" from the fast dial register. Next at step 220 the 
device forms a tactile feedback to the user by aid of a vibrator 315, in order to 
confirm the user that "dial 4" is now selected. The feedback can be for example four 
vibration pulses (duration e.g. 20 ms). 

5 

After that there are two alternatives to progress. In the first alternative after the 
feedback is produced at step 220, the device can make automatically a 
communication connection to "Henri" and to number "0500 8903768" and the flow 
proceeds from step 220 to step 202. 

10 

In the second alternative the flow proceeds to step 202 as described above, wherein 
a signal from the motion sensor 314 is again waited. The next thing the user now 
has to do is to activate the phone call by giving e.g. a double tap. The device detects 
the double tap (steps 203-207) and activates the selected number (step 212). Next 
15 the flow proceeds to step 217, wherein the device produces a tactile feedback in 
order to inform the user about confirmation of the activation. The feedback can be 
e.g. a single shake, or a longer lasting vibration pulse, e.g. five times as much as the 
vibration of one single vibration pulse. 

20 When the user wants to end the phone call, he/she just taps twice (in this example) 
the device in order to terminate the phone call. The device detects at step 203 first 
tap, at step 204 it is also detected that the phone call is in progress and the flow 
precedes to step 221, wherein the taps are counted. If two taps are detected at step 
221, the flow proceeds to step 222, wherein the call is terminated and finally the 

25 ending of the call is confirmed to the user with a vibration (step 223). After step 223 
the flow proceeds to step 202. 

Regarding to steps 206-210, the device detects the difference of taps e.g. as 
explained in the following. When the first tap is detected a counter in the device is 
30 reset (T=0) and it starts to count time (T=T+1). Let us assume here that one unit of 
time here is one millisecond (ms). If the next tap is detected in less than e.g. 200 ms, 
then a double tap is detected. If the next tap is detected in more than said 200 ms but 
in less than e.g. 4000 ms, then two taps is detected. 

35 It is to be noted that the method according to the invention is not restricted to the 
examples as illustrated above. It is evident that other implementations are possible 
as well. E.g. the following examples can become in question; a phone is in a bag or 
pocket and a user wants to silent a disturbing incoming call alert and/or soft rejects 
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the call (one or several taps). The user wants to enable speech recognition control. 
A tap activates the control and a vibration pulse or pulses (e.g. 5 pulses) confirm 
activation. A double tap can activate an emergency call. A single tap can activate a 
volume control for headset, a vibration to confirm said activation and further taps to 
5 increase or decrease the volume level. Fast forward (one tap) or fast rewind (two 
taps) for e.g. 5 seconds in voice messages. Furthermore, tap control can be 
combined with other gestures or control means, e g. tap enables shake/tilt gesture 
input for next 2 seconds time. 

10 Figure 3 illustrates a block diagram of an electronic device 300 according to an 
embodiment of the invention. The device comprises a processor 301 and a memory 
302 for processing the operations being performed in the device 300. The device 
can also comprise a storage medium 303 for storing applications and information, 
e.g. Phonebook 304, Games 305, a speed dial register 306 and messages 307, like 

15 SMS and/or MMS messages. The device further comprises a keyboard 308 and a 
display 309 for inputting and outputting information from and to the user of the 
device. The device 300 is connectable to a communication network and/or to 
another devices by means of a transceiver 3 10, an antenna 311 and an Input/Output 
means 313 e.g. an infrared connection or cable connection, such as an USB-, Blue 

20 tooth, Serial- or Fire Wire connection, for example. The device 300 further 
comprises a motion sensor 314 for detecting motion, e.g. a tap and/or a gesture 
made by the user of the device. The motion sensor 314 is capable of detecting 
motion in at least one direction of at least one of the X, Y, or Z-axis as illustrated in 
figure 4. The motion sensor 315 can be capable of detecting motion to all six 

25 directions as illustrated in figure 4 (X, -X, Y 5 -Y, Z and -Z directions) 

The device 300 is a wireless communication device, such as a mobile telephone 
operating in a communication system such as GSM system for example. The device 
can be further or alternatively a portable game console capable of providing to the 

30 user games stored in the device 300. For example the user can move a game cursor 
on the display of the mobile phone by tapping one of the sides of the mobile 
telephone. The user can accept his move for example by tapping the front of the 
mobile phone. By aid of transceiver 310 and antenna 311 or Input/Output means 
313 it is possible to connect the device 300 in communication connection with one 

35 or several other game console devices in order to play network games. 
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Figure 4 illustrates a communication device according to an embodiment of the 
invention. The figure illustrated the device 300 and a three dimensional coordinate 
system with Y- and Z-axis. 

5 The above disclosure illustrates the implementation of the invention and its 
embodiments by means of examples. A person skilled in the art will find it apparent 
that the invention is not restricted to the details of the above-described embodiments 
and that there are also other ways of implementing the invention without deviating 
from the characteristics of the invention. The above embodiments should thus be 
10 considered as illustrative and not restrictive. Hence the possibilities of 
implementing and using the invention are only restricted by the accompanying 
claims and therefore the different alternative implementations of the invention, 
including equivalent implementations, defined in the claims also belong to the 
scope of the invention. 
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